Mixture Models and Expectation-Maximization
نویسنده
چکیده
This tutorial attempts to provide a gentle introduction to EM by way of simple examples involving maximum-likelihood estimation of mixture-model parameters. Readers familiar with ML paramter estimation and clustering may want to skip directly to Sections 5.2 and 5.3.
منابع مشابه
Identification of Nonlinear Systems using Gaussian Mixture of Local Models
Identification of operating regime based models of nonlinear dynamic systems is addressed. The operating regimes and the parameters of the local linear models are identified directly and simultaneously based on the Expectation Maximization (EM) identification of Gaussian Mixture Model (GMM). The proposed technique is demonstrated by means of the identification of a neutralization reaction in a ...
متن کاملMaximum Conditional Likelihood via Bound Maximization and the CEM Algorithm
We present the CEM (Conditional Expectation Maximization) algorithm as an extension of the EM (Expectation Maximization) algorithm to conditional density estimation under missing data. A bounding and maximization process is given to speci cally optimize conditional likelihood instead of the usual joint likelihood. We apply the method to conditioned mixture models and use bounding techniques to ...
متن کاملSpoken Language Identification for Indian Languages Using Split and Merge EM Algorithm
Performance of Language Identification (LID) System using Gaussian Mixture Models (GMM) is limited by the convergence of Expectation Maximization (EM) algorithm to local maxima. In this paper an LID system is described using Gaussian Mixture Models for the extracted features which are then trained using Split and Merge Expectation Maximization Algorithm that improves the global convergence of E...
متن کاملMaximum Conditional Likelihood
We present the CEM (Conditional Expectation Maximization) algorithm as an extension of the EM (Expectation Maximization) algorithm to conditional density estimation under missing data. A bounding and maximization process is given to speciically optimize conditional likelihood instead of the usual joint likelihood. We apply the method to conditioned mixture models and use bounding techniques to ...
متن کاملDiscrete mixture regression models for heterogenous time-to-event data: Cox assisted clustering
Despite mounting evidence that genetic subgroups for the same clinical disease exist in cancer genomic studies, little attention has been given to exploring how this heterogeneity affects statistical model building. We describe a discrete mixture model that is able to identify and model unforseen heterogeneity in regression problems for time-to-event data. Our illustrations highlight the variet...
متن کامل